Fusion of 2D Face Alignment and 3D Head Pose Estimation for Robust and Real-Time Performance
نویسندگان
چکیده
In order to perform coherent and robust interpretation of moving faces, one must resolve the inconsistency and ambiguities observed among multiple sources of highly noisy visual measurements. In this work, we describe a method for perceptual fusion through the estimation of observation covariance. We demonstrate the approach through a working system that performs real-time face detection and tracking in live video sequences. The use of perceptual fusion aims to address the difficult problem of simultaneous 2D face alignment and 3D head pose estimation during tracking.
منابع مشابه
Face Alignment Assisted by Head Pose Estimation
In this paper we propose supervised initialisation scheme for cascaded face alignment based on explicit head pose estimation. We first investigate the failure cases of most state of the art face alignment approaches and observe that these failures often share one common global property, i.e. the head pose variation is usually large. Inspired by this, we propose a deep convolutional network mode...
متن کاملHybridization of Facial Features and Use of Multi Modal Information for 3D Face Recognition
Despite of achieving good performance in controlled environment, the conventional 3D face recognition systems still encounter problems in handling the large variations in lighting conditions, facial expression and head pose The humans use the hybrid approach to recognize faces and therefore in this proposed method the human face recognition ability is incorporated by combining global and local ...
متن کاملFine-Grained Head Pose Estimation Without Keypoints
Estimating the head pose of a person is a crucial problem that has a large amount of applications such as aiding in gaze estimation, modeling attention, fitting 3D models to video and performing face alignment. Traditionally head pose is computed by estimating some keypoints from the target face and solving the 2D to 3D correspondence problem with a mean human head model. We argue that this is ...
متن کاملDense 3D face alignment from 2D video for real-time use
To enable real-time, person-independent 3D registration from 2D video, we developed a 3D cascade regression approach in which facial landmarks remain invariant across pose over a range of approximately 60 degrees. From a single 2D image of a person’s face, a dense 3D shape is registered in real time for each frame. The algorithm utilizes a fast cascade regression framework trained on high-resol...
متن کاملStructure From Motion for Real-time 3D Head Pose Recovery
This paper presents a robust and recursive means of tracking and modeling faces in near-field video sequences. An Extended Kalman Filter is coupled with a generic wire-frame face model and a correlation based 2D tracking process, providing a recursive means of recovering simple camera geometry, head pose and object structure. Head pose parameters are used to animate the texture-mapped face mode...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1999